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TECHNICAL REPORT 


The RICIS Concept 


The University of Houston-Clear Lake established the Research Institute for 
Computing and Information Systems (RICIS) in 1986 to encourage the NASA 
Johnson Space Center (JSC) and local industry to actively support research 
in the computing and information sciences. As part of this endeavor, UHCL 
proposed a partnership with JSC to Jointly define and manage an integrated 
program of research in advanced data processing technology needed for JSC’s 
main missions, including administrative, engineering and science responsi- 
bilities. JSC agreed and entered into a continuing cooperative agreement 
with UHCL beginning in May 1986, to jointly plan and execute such research 
through RICIS. Additionally, under Cooperative Agreement NCC 9-16, 
computing and educational facilities are shared by the two institutions to 
conduct the research. 

The UHCL/RICIS mission is to conduct, coordinate, and disseminate research 
and professional level education in computing and information systems to 
serve the needs of the government, industry, community and academia. 
RICIS combines resources of UHCL and its gateway affiliates to research and 
develop materials, prototypes and publications on topics of mutual interest 
to Its sponsors and researchers. Within UHCL, the mission Is being 
implemented through interdisciplinary involvement of faculty and students 
from each of the four schools: Business and Public Administration, Educa- 
tion, Human Sciences and Humanities, and Natural and Applied Sciences. 
RICIS also collaborates with industry in a companion program. This program 
is focused on serving the research and advanced development needs of 
industry. 

Moreover, UHCL established relationships with other universities and re- 
search organizations, having common research interests, to provide addi- 
tional sources of expertise to conduct needed research. For example, UHCL 
has entered into a special partnership with Texas A&M University to help 
oversee RICIS research an*! education programs, while other research 
organizations are involved via the “gateway* concept 

A major role of RICIS then is to find the best match of sponsors, researchers 
and research objectives to advance knowledge in the computing and informa- 
tion sciences. RICIS, working Jointly with its sponsors, advises on research 
needs, recommends principals for conducting the research, provides tech- 
nical and administrative support to coordinate the research and integrates 
technical results into the goads of UHCL, NASA/JSC and industry. 
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Abstract 


Although computers have come a long way since their Invention, they are 
basically able to handle only crisp values at the hardware level. Unfortunately, the 
world we live in consists of problems which fail to fall into this category, l.e. 
uncertainty is all too common. In this work, we look at a problem which involves 
uncertainty. To be specific we deal with attributes which are fuzzy sets. Under this 
condition we acquire knowledge by looking at examples. In each example a 
condition as well as a decision is made available. Based on the examples given to us, 
we will extract two sets of rules namely: certain and possible. Furthermore we will 
construct measures of how much we believe these rules, and finally we will define 
the decisions as a function of the terms used in the conditions. 
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CHAPTER 1 


INTRODUCTION 

Despite the advancements made In computer technology to date, most 
of the computers on the market today are stored program sequential processing 
machines built around the Von Neumann architecture, the principles for which date 
back to the Turing machine, a computing model first proposed by Alan Turing in 
1936. This means that, in principle, modem day computers are designed primarily 
to carry out mathematical calculations. Human expectations vis-a-vis computers 
know no bounds. These expectations go beyond routine Jobs such as numerical 
calculations and the processing of office work, to include support in decision- 
making processes, the ability to understand natural languages, the diagnosis of 
malfunctions and the processing of intellectual information such as that required in 
design and planning work. To accomplish these kinds of operations, symbol 
processing computers equipped with inference functions are required. However, 
even symbol processing machines are not capable of handling experience and 
intuition, two very important aspects of intelligence. This is because conventional 
computers are extremely crisp . (i.e. capable of dealing with definite values) having 
being designed around the binary logic of Boolean algebra. Human experience and 
intuition, however, by their very nature are multi-numerical. In other words, they 

are fuzzy. 

This raises the question of Just how necessary it is to have computers 
that are capable of processing ambiguous information, such as human experience 
and intuition. After all can’t most phenomena encountered in this world be 
thoroughly processed mathematically? This question has been raised because today's 
computers are only used to solve well -structured problems for which all information 
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is available. However, the everyday real world in which we live is rife with problems 
for which not all information is available, and which are not well structured. This 
project focuses on such a problem, for which all information is not available and/or 
not well structured. 


1.1 The Problem at Hand 

Expert systems of a certain kind rely essentially upon the availability of a 
method for handling uncertainty. These systems cannot be conceived without a 
decision being firstly made about the choice of this method. Obviously this is true for 
all expert systems using empirical knowledge which in itself is not absolutely certain. 
As an example, we could mention a medical expert system which draws conclusions 
from the observed symptoms about whether or not a certain disease is present. All 
conclusions of this type inevitably contain an amount of uncertainty. However the 
rules which lead to these conclusions should not be confused with classical logical 

rules and must not be treated in the same way. 

We shall call expert systems of this type diagnostic systems . They are 
mostly in the field of medicine, but can also be used in many other applications such 
as meteorology or geology, and of course for the control of technical installations. 
Therefore the expression diagnostic system should always be understood in the 
sense of an expert system, which relies upon empirical interdependencies for 
drawing its conclusions and consequently requires the treatment of uncertainty. 

In order to make it possible to decide upon an appropriate therapy, a 
quantitative measure of uncertainty has to be applied in all relevant cases of a 
diagnostic system. Moreover it may be sensible to establish rules which, in certain 
stages of the Investigation, direct the investigator's efforts depending on the degree 
of certainty achieved for possible hypothesis. 
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It is evident therefore, that for researchers who design diagnostic 
systems the question has to answered, as to which method of measuring uncertainty 
should be employed. For more than three hundred years scientists, philosophers, 
mathematicians and statisticians have used the concept of probability to describe 
degrees of uncertainty. Over three centuries a huge amount of theoretical results 
and experiences concerning the applicability of probability theory in different fields 
of human knowledge has been accumulated. Nevertheless many doubts concerning 
the appropriateness of the use of probability in diagnostic systems have arisen during 
the last decade. In the following sections we look at the probability theory and see 
why this is so. 

1.2 Reasoning and Probability Theory. 

Decision making often involves the use of rules. Simple rules are 
acceptable to most people in their everyday life, e.g. 

In India, if you are under 60 years of age then you are entitled to a retirement 

position. 

A rule for entitlement might be more complex, but understandable, e.g. 

If you are at least 60 years old and female and you have been resident in India 
for at least 25 years, or if you are male and at least 65 years old and you have 
been resident in India for at least 30 years then, provided you are not 
receiving a disability pension, you are entitled to the retirement position. 
People use ’if .... then....' statements in conversation, and often use rules in their 
everyday lives. However, problems which require expertise are not deterministic, 
i.e. the solutions cannot be stated in simple rules. Where Judgement is involved, 
people often use words like probably, unlikely, almost certainty. i.e. uncertainty is 
involved. In some cases they quantify what they mean. For example: 

I am 99 % confident that if you water the plant, its condition will improve. 
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There is a small risk, about 5%, that you have this disease. 

The ways In which people use these percentages are 111 defined and often 
inconsistent. However, as we shall see in subsequent sections, there are 
mathematical theories which provide logical models for uncertainty. 

1.2.1 Probability Theory. 

Probability theory originated in the seventeenth century in the context 
of gambling. A gambler assesses his chance of winning and therefore the risk 
associated with his bid {31. This process is very similar to that of an expert weighing 
up evidence, and judging whether he has sufficient evidence to justify a particular 
course of action. Chance, expectation and risk are components of both probability 
theory and expert judgements. 

Probability is a measure of certainty between 0 and 1. The extreme values 
denote impossibility and certainty. Most people would understand that if a fair coin 
is tossed then the probability of its landing on a certain side is 0.5. This is because 
we ignore the possibility of its landing on its edge or not landing at all. and the 
other two outcomes are equally likely. Furthermore, only one of the events (head or 
tail) can occur at once. i.e. the events are mutually exclusive. This leads us to the 
classical definition of probability: 

If a random experiment has N possible outcomes which are all equally 
likely and mutually exclusive, and n of these possibilities has 
outcome A then the probability of outcome A is n/N. 

For example, consider a standard pack of 52 playing cards which has been shuffled 
so that the order of the cards is unpredictable. If a card is picked at random then 
the chance that it Is a club is 13/52 = 0.25. This is a very simplistic view of 
uncertainty. The definition depends on the terms random, mutually exclusive and 
equally likely. It cannot help much with questions like: 
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What is the probability that a child bom (n the United States will be a male? 
What is the probability that the pain is caused by indigestion, and not a 
serious illness? 

These are all real questions, and experts continually make similar judgements. If we 
looked at the record of births in the United States over the past two years then we 
could calculate the relative frequency of male births, i.e. the ratio of number of boys 
to number of births. We would expect this to be close to the true probability. 
Assuming that there had been no genetic changes, a more reliable estimate could be 
obtained from the records of the past ten years. So, If we can imagine a series of 
observations under constant conditions then the probability p of event A can be 
approximated by the relative frequency of A in a series of such observations. In 
practice ’true' probabilities are almost impossible to quantify, and most probabilities 
used are estimates based on relative frequencies. 

1.3 Why not Classical Probability Theory? 

Even though, the basic ideas prevailing in some considerations about 
diagnostic systems sound convincing, they violate fundamental requirements for 
reasonable handling of uncertainty. These ideas may be described as follows: If a 
certain fact is observed, a measure M i of uncertainty concerning the hypothesis in 
question must exist. If in addition another fact is observed, which produces a 
measure M 2 with respect to the same hypothesis, a combination rule must be given, 
which yields the measure of uncertainty of this hypothesis resulting from both 
observations. Such a rule, which calculates the measure of uncertainty for the 
combined observation as a function of the measures M 1 and M2 can never take into 
account the kind of mutual dependence of the two observed facts. It might well be 
that these facts nearly always occur together, if indeed they occur at all. In such a 
situation the second observation Is redundant and should not be used to update the 
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measure of uncertainty. In another situation the two facts very seldom occur 
simultaneously and If they do. then this Is an Important Indication concerning the 
hypothesis in question. If they do occur simultaneously, the updating of the measure 
of uncertainty should have drastic consequences. Classical probability theory which 
treats these two situations equally cannot be considered useful. 

Another argument against the probability theory is that : Is it justifiable 
to attribute a certain measure of uncertainty to the observation of a given fact, 
irrespective of the circumstances? For example let's take the example of a medical 
diagnostic system: If a symptom Z is observed, and a measure of uncertainty is used 
concerning the hypothesis of the presence of a certain disease, can this measure 
remain valid, if this disease occurs much more frequently than before? Once again 
an appropriate use of probability theory reveals the kind of dependence prevailing in 
this case. However, this will not be a popular result, because it states that a 
diagnostic system using this type of measure of uncertainty cannot be applied to 
populations showing different frequencies of this disease. 

The problems of using probability models are compounded by the fact 
that people do not really understand the theory [61. The theory itself is consistent 
and correct, but in order to apply it we need to make assumptions about underlying 
distributions and independence and sometimes use sophisticated mathematics to 
develop a consistent model for the system. Even given a consistent model people 
find it hard to estimate conditional probabilities, if enough data is not provided. 
Statistical tests are a method of using probability theory to Judge the weight of 
evidence and of selecting an hypothesis from two alternatives. However, many of 
the theorems and methods needed when using probabilities in diagnostic systems 
require the expert to estimate probabilities, sometimes without recourse to relative 
frequencies. Yet another problem with forcing experts to describe their inference in 
terms of probability theory is that the theory is not a natural method of reasoning. 
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1.4 Discussion 

Recently, a lot of time and effort has been expended by the expert 
systems research community to the acquisition of knowledge under uncertainty. 
Uncertainty arises in many different situations. It may be caused by the ambiguity in 
the terms used to describe a specific situation, it might be caused by skepticism of 
rules used to describe a course of action or by missing and/or erroneous data. 

In order to deal with uncertainty, techniques other than classical logic 
need to be developed. Statistics is the best tool available to handle likelihood. 
However, in many cases probabilities need to be estimated, sometimes without even 
recourse to relative frequencies.^ Estimates, then are likely to be very inaccurate. 
Many authors have cited theoretical weaknesses of expert systems based on 
statistical technique. In particular, there has been an attempt to create a system for 
the verification of indications for treatment of duodenal ulcers by HSV on the basis 
of statistics. The results were counter-intuitive and the system was rejected by 
physicians. The Dempster- Shafer theory of evidence or the theory of belief 
functions, give a useful measure for the evaluation of subjective certainty. The 
Dempster-Shafer theory has recently become popular. For an in depth-look at the 
Dempster-Shafer theory the reader is referred to 1 10]. Fuzzy logic, based on 
Zadeh’s theory of fuzzy sets (where the degree to which an optional element (a) 
belongs to set (A) is determined by assigning it a value or grade ranging from 0 to 1 ) 
is another means of handling uncertainty. However, this too has problems 19]. 

There is extensive literature on ways to deal with uncertainty in expert systems, like 
a combination of statistics and fuzzy logic, theory of endorsements (1], non-monotic 
logic (7. 8], modal logic etc. [5]. 

One of the most popular ways to acquire knowledge is based on learning 
from examples. An effective tool to infer knowledge from examples is rough #et 
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theory. Rough set theoiy was introduced in 1981 by Z. Pawlak as a method to 
acquire knowledge under uncertainty. The main assumption of the rough set theory 
is that the information stored In the data base like system, called an information 
system, may contain inconsistencies. In the process of acquiring knowledge these 
inconsistencies are taken Into account. Thus, using the basic tools of rough set 
theory, which we will look at closely In the next chapter, two sets of rules are 
produced namely certain and possible . The main advantage of the rough set theory 
is that it does not need any preliminary or additional Information about data like 
probability In statistics. Moreover rough set theory has been successfully 
implemented in knowledge-based systems in medicine and industry. In particular, 
an expert system based on rough set theory for engineering design is being 
developed at Wayne State University, Michigan, and University of Regina, Canada. 


1.5 Scope. 

In this work, we will deal with a setting where a decision maker is 
faced with uncertain (i.e. fuzzy) symptoms and makes a fuzzy diagnosis which might 
be strongly or weakly based on these symptoms. The cases which we will look at are 
not "textbook cases" and the values of attributes are not crisp. Moreover the 
diagnosis is not of a "pure type". It Is a mixture of several "pure types". Thus, a 
patient might have a diagnosis of the type ,3/D A + 6 /Db meaning that the physician 
believes the fuzzy symptoms reflect disease Da with strength .3 and disease Db with 
strength .6. From such a setting we will extract fuzzy rules using the rough set 
theory. 

Fuzzy rules are naturally present In descriptions, crisp rules are the 
exceptions. Also, fewer fuzzy rules are needed than crisp ones to build an expert 
system. Thus a rule such as : If the tumor is somewhat large then the presence of 
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skin cancer is somewhat likely is the type of rule experts naturally use as oppos ed to 
giving the size of a tumor and a number expressing the probability of cancer. 

In the first part of this work we will develop a methodology to extract 
rules such as the ones stated above, from fuzzy symptoms and fuzzy diagnosis. In 
fact we will extract two sets of rules i.e. certain and possible rules as well as a 
measure of how much we believe these rules. In the second part we will look at a 
related problem that is to define the diagnosis in terms of the symptoms. In the 
next chapter we take an in-depth look at the rough set theory which is necessary to 
understand the rest of this paper. 
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CHAPTER 2 


ROUGH SETS 

Acquiring knowledge under uncertainty is one of the main problems of 
expert systems. One of the most popular ways to acquire knowledge is based on 
learning from examples. In 1981, Z. Pawlak Introduced a new tool, namely rough 
set theory to acquire knowledge under uncertainty. In this chapter we look at the 
basic concepts of rough set theory. Other methods have been developed prior to the 
introduction of rough set theory. However, use of the rough set theory seem to have 
many advantages over the other methods. One of the main advantages of the rough 
set theory is that it does not need any preliminary or additional information about 
data (like probability in statistics, basic probability number in Dempster-Shafer 
theory, grade of membership, or the value of possibility in fuzzy set theory). 

Another advantage of rough set theory is that its algorithms are very simple, and the 
theory itself is clear and easy to follow. Moreover the theory has been successfully 
implemented in many cases in expert systems In medicine and industry. 


2.1 Basic Notations and Concepts 

All the concepts mentioned in this section can be found in (4). Let U be 
a non empty set, called the universe, and let R be an equivalence relation on U 
called an indisceralbillty relation. An ordered pair A = (U.R) is called an 
approximation space. For an element x of U. the equivalence class of R containing x 
will be denoted by Mr. Equivalence classes of R are called elementary sets in A. We 
assume that the empty set is also elementary. Any finite union of elementary sets in 
A is called a definable set in A. 
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Let X be a subset of U and we wish to define X In terms of definable sets 
In A. Thus, we need two more concepts. A lower approximation of X in A, denoted 
by EX. Is the set given by 

{x e U I IxlR C X }. 

An upper approximation of X in A denoted by RX, Is the set given by 

{x £ U I Mr n X * <|> } 

The lower approximation of X in A is the greatest definable set in A, 
contained in X. The upper approximation of X is the least definable set In A 
containing X. A rough set in A (or rough set. if A is known ) is the family of all 
subsets of U having the same lower and upper approximations in A. 

Let X and Y be subsets of U. Lower and upper approximations of X and Y 

in A have the following properties: 

EX C X C rx, 

EU = U = RU. 

R 6 = 4> = R4>. 

R(X u Y) aE.X u BY. 

R(X U Yi = RX U RY. 

E(X n Y) = EX n E y. 
r(x n Y) c rx n RY. 

E1X-Y]C EX - EY. 

R(X-Y) 2 RX - RY, 

B(-X) = -RX, 

R(-X) = -EX 
EX UR(-X) = X. 

B(RX) = R(EX) = BX. 

R(RX) = £(RX) = RX 

where -X denotes the complement U-X of X. 


Let x be an element of U. We define two additional membership relations £. 

and e , called strong and weak memberships, in the following way 

x £_ X iff x £ RX 

and 

x e x ifT x £ RX 

with meanings: x is certainly in X and x is possibly in X respectively. Our 
terminology originates in that we want to decide if x is In X on the basis of definable 
sets in A rather than on the basis of X. This means that we deal with RX and RX 
instead of X, and since RX C X C RX, if x is in RX it is certainly in X. On the 

other hand, if x is in RX, it is possibly in X. 

2.2 Information Systems 

An information system is similar to a data base. The difference is that 
the entitles of such an information system, called objects, do not need to be 
distinguished by attributes. The information system serves as the basis for 
knowledge acquisition, producing rules from examples. Therefore, attributes are 
divided into two types: conditions and decisions (or actions). Objects are described 
by values of conditions, while classifications made by experts are represented by 
values of decisions. 

For example, if the system is a hospital, the objects would be patients, 
the condition attributes would be tests, and the decision attributes would be 
diseases. Each patient would be characterized by test results and would be classified 
by physicians (experts) as being on some level of disease severity. As another 
example if the system Is an industrial process, the objects would be sample of 
processes taken at some specific moments in time. Conditions would be the 
parameters of the process, while the decisions would be actions taken by the 

operators (experts). 
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An Information system S Is a quadrapule (U.Q.V,P)where U is a non 
empty finite set, and its elements are called objects of S, Q = C L D is a set of 

attributes. C is a non empty finite set. its elements are called condition attributes of 
S. and D is also a non empty finite set, and its elements are called decision 
attributes of S, D DC = <♦>. 

V = UqeQVq is a non empty finite set, and its elements are called values of 

attributes, where V q is the set of values of attribute q, called the domain of q. and 
p is a function of U x Q onto V, called a description of S. such that p(x.q) £ V q for 

all x e U and q £ 9 

Let P be a nonempty subset of Q. and let x, y be members of U. Objects x and 
y are indiscernible by P in S, denoted by x T 5 y. iff for each qlnP, p(x,q) = p(y.q). 
Obviously, P is an equivalence relation on U. Thus P defines a partition on U; such 
a partition is a set of all equivalence classes of P. This partition is called a 
classification of U generated by P in S, or briefly a classification generated by P. 


2.3 Rough Deflnibility of a Set 

For a non empty subset P of Q, an ordered pair (U, P) is an 
approximation space A, For the sake of convenience, for any X £U, the lower 

approximation of X in A and the upper approximation of X in A will be called P- lower 
approximation of X in S and P- upper approximation of X in S. and will be denoted by 
EX and PX, respectively. A definable set X in A will be also called P -definable in S. 

Thus, X is P-definable in S iff EX = PX 

For a non empty subset P of Q, a set X £U which is not P-definable in 

S = (U. Q, V, P) will be called P-undefinable in S. Set X is P-undefinable iff 

EX * PX 

The set X will be called roughly P-definable in S iff EX * 4* and PX * U. 

The set X will be called internally P-undefinable in S iff £X = <t> and PX * U. 
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The set X will be called externally P-undeflnable In S LfT PX * <t> and PX - U. 
The set X will be called totally P-undefinable in S iff EX = $ and PX = U. 

For an Internally P-undeflnable set X In S we can not say with certainty 
that any x e U Is a member of X. For an externally P-undeflnable set X In S we 
cannot exclude any x e U being possibly a member of X. In the next section we look 

at an example which illustrates the above mentioned concepts. 

2.4 An Example 

Let us look at the information system which Is given by the following 

table. 

Table 1 . An example of information system: 


- 


G 

— 


C 

D 

1m# 


Temperature 

Headache 

Influenza 

- 

XI 

normal 

no 

no 


X 2 

normal 

yes 

no 



X3 

normal 

yes 

yes 


X4 

subfebrile 

no 

no 

— 

X5 

subfrebile 

yes 

■ 

no 

w 

X6 

subfebrile 

yes 

yes 


X7 

high 

no 

yes 

— 

X8 

high 

yes 

yes 

«pr 

X9 

high 

yes 

yes 


w 
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The classification, generated by the set C of conditions attributes, 
called Temperature and Headache, is equal to 

{ (XiK {X 2 . X 3 ). (X 4 ). (X 5 . Xg), {X 7 }, (X 8 . X 9 ) }. 

The set D of decision attributes consists of one member, called 
Influenza. As can be seen in the table, an expert Introduced two inconsistencies. 

First, he assigned different values of condition attributes to patients X 2 and X 3 . in 
spite of the fact that both patients, X 2 and X 3 . characterized by the same values of 
condition attributes Temperature and Headache. Yet another inconsistency Is 
associated with patients X 5 andxg. 

Let us assume that X = { x I p(x, d ) = no), i.e. X = {xi , X 2 , x 4 , xs(. 
Thus X represents all patients in U, classified by an expert in the same way. as 

being not sick with Influenza. Then 

£X = (xi) U (x 4 ) = (xi . x 4 ), 

CX = {x 1 } U {X2 . X3} U {x 4 } U (X5. X6) = {xi . X2. X3. x 4 , X5. xg) 
It Is the presence of inconsistencies that produce a difference between the lower 
and upper approximation. 

In our example, £X * 4> and CX * U. therefore X is roughly C-deflnable in S. 
For set X. sets CX and CX are illustrated by the following figures: 



IS 



Figure (a) lower approximation £.X of set X 



Figure (b) upper approximation CX of set X. 


The set X determines the following rough set: 

{ {xi . X 2 . X4, X5 }. (xi , X 2 , X4. X6 ), {xi . X3. X4, X5}. {xi . X3. X4. x6> )• 
For example, xi £_ X, hence xi G X, andx3 £_X, butx3 e X 

Now let us represent the decision of the expert from the example, 
corresponding to set X, by rules. Any such a rule Is a conditional statement that 
specifies a decision under conditions. The smallest subsets of U which may be 
described by rules, using the set C of conditions, are the members of the 
classification generated by C. Therefore, we may represent set X by rules iff X is in- 
definable. If set X is C-undefinable we cannot represent it by a single set of rules. 
Instead, we may represent sets CX and CX by different sets of rules. In particular a 
rule derived from CX is certain, and a rule derived from CX Is possible. 

In the example, X is roughly C-definable in S. The certain rules, 
corresponding to set CX of positive examples and set -CX of negative examples, are 

(Temperature, low) --> (Influenza, no) 
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(Temperature, subfebrile) A (Headache, no) --> (Influenza, 

no). 

and the possible rules, corresponding to set CX of positive examples and set -CX of 

negative examples, are 

(Temperature, low) --> (Influenza, no) 

(Headache, no) --> (Influenza, no). 

As can be seen from the above example, uncertainty is all too often 
present in the conditions and the decisions. The conditions and the decisions fail to 
partition the universe into well defined classes and some overlap is present. In real 
cases we do not have sharp boundaries between say normal, subfebrile, and high. 
The best we can hope Is that normal, subfebrile, and high, somewhat partition 
the universe by not overlapping "too much." In the next chapter we will look at a 
method which would help us deal with such a setting, where attributes fail to have 
sharp boundaries. 
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CHAPTER 3 


FUZZINESS AND FUZZY SETS 

The way we humans actually store and manipulate concepts in the mind 
is a subject of some debate. However, we communicate conscious processes to 
other people verbally. This type of reasoning Is done with words rather than 
numbers.Thls is why we find probability theory counter-intuitive, and In some cases 
difficult to understand. The many shades of meaning which give language its 
richness and colour contrast with the precise rigour of mathematical theory, logic 
and computer languages. 

There is a difference between the meaning and usage of words. It is not 
the strict dictionary definition of a word which is important, but the way In which 
an expert uses a word. At times an expert may find it difficult to define a particular 
word, though usually he will be able to give an example of a use. We usually find 
technical terms relatively easy to define. However, commonly used words are less 
easy to define, either in abstract or even In context. For example let's consider the 
word "cold". What Is the criterion for saying that the weather is cold? The answer 
depends on factors like temperature and the time of year. For Instance a cold 
summer s day can be milder than a warm winter’s day. It Is relatively easy to quote 
examples of cold days and days which are not cold. There is a vagueness or fuzzi n ess 
about a certain range of temperatures; they might constitute coldness, and they 
might not. In this chapter we take an in-depth look at this aspect of vagueness or 
fuzziness. 


18 



3.1 Fuzziness 

Everyone uses fuzzy words In their everyday lives, and seldom question 
whether they or others understand their usage of those words. An individual may not 
be consistent in his own use of words, and there is even less chance that someone 
else has the same usage. Nevertheless, we all use words expressing belief when we 
are reasoning or arguing. For example, let us look at a quote from a doctor. 

"I wouldn't expect that disease in a young girl of 20. It's so rare as to be 
negligible. It isn't worth carrying out the test on a young person. If they're 
young I’d most likely not do the tests. If they are older I probably would do 
them." 

Here the doctor is using vague rules. Some fuzzy words which he uses are young, 
older, negligible, so rare, most likely, probably etc. When pressed to define such 
words, experts often find it extremely difficult. 

There is also a distinction between uncertainty and imprecision, which 
is not always reflected in the models used in computer systems. Uncertainty refers 
to something which is not known for sure, and imprecision refers to something 
whose value is not known accurately. Statements can be uncertain. Imprecise or 
both. For example: 

'There will definitely be a rise in temperature: somewhere between 10 
degrees and 25 degrees." 
is imprecise but certain whereas: 

"I think you should leave it on. If so you should set it to 180 degrees." 
is precise but uncertain. 

3.1.1 IF .... THEN rules 

Crisp mathematical rules can be easily defined. The basis for a rule is: 

IF A then B or A ~> B 
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This states that If A Is true, then B Is necessarily true loo. It does not state that B 
implies A. and B can be true with A false. It is difficult to find a clear example of this 
concept except In the context of mathematics, for example: 

If X = 2 then X2 = 4 

Note that X 2 = 4 does not mean that X is the value 2; X = -2 is another solution. The 
rule is exactly equivalent to: 

Not B --> Not A 

Unfortunately. In common usage "if' and "only if' are interchanged and used 
Improperly all too often. 

Statements based on logic are made more complex by the use of AND 
and CR. AND is easy to understand, but CR is ambiguous. If a child is told "You can 
have sweets or an ice cream”, the child will usually understand that she is not 
allowed both. This is an exclusive CR. The statement "The leaves on the tree are 
green or yellow" implies that possibly some leaves are green and others are yellow. 
This is an inclusive CR: Yellow and green can occur together. The English language 
does not distinguish between these two meanings, and the interpretation may 
depend on the context. In formal logic and computer logic, the inclusive CR is 
more common. Further ambiguities arise when both terms AND and OR are used in 
the same statement. For example let us consider the rule: 

"If the patient is over 40 and has high blood pressure or is female then I 
would refer them." 

Does this statement mean: 

"If the patient is over 40 and has high blood pressure or if the patient is over 
40 and is female then I would refer them.” 
or does it mean: 

"If the patient is over 40 and has high blood pressure or if the patient is 
female then I would refer them." 
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Only the person who made the statement can identify the correct interpretation. 

Note that the two Interpretations give potentially different outcomes for a female 
patient under the age of 40. Again, In computer logic the meaning Is unambiguous - 
the problem arises because of the way we use words. 

3.1.2 Symptoms 

Much Judgement and reasoning using vague rules involve weighing up 
the strength of evidence In symptoms. For example; 

"Meniere's disease causes spells of dizziness." 
is a rule of the form: 

If A then B 

i.e. if you have Meniere's disease then you will have spells of dizziness. If we are told 
that a patient has spells of dizziness then it is more credible that he has Meniere's 
disease. However, dizziness can be caused by other illnesses or disorders. If 
dizziness is a common ailment for this type of patient then we do not have much 
evidence for Meniere's disease, but if it is rare except as a consequence of the 
disease, then our inference is stronger. The strength of our inference depends on 
how likely B Is in itself. If B is very common, then we have little evidence for A; if B 
is very rare then A becomes much more credible. So B is true makes A more 
credible is our vague rule. 

In practice, there is usually more than one symptom, or evidence, i.e. 

the rule is : 

A — > B i , B2 Bn 

For example: 

"Meniere's disease causes spells of dizziness, tinnitus, and progressive 
hearing loss." 
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This form of reasoning is the one which is often represented by Baye's rule. The 
weights of evidence used in the doctor s diagnosis are not independent; it is a 
combination of symptoms which gives credibility to the solution. 

3.1.3 Uncertainty in Data 

The vagueness or uncertainty which is an intrinsic feature of Judgement 
is not unique to rules. Data presented to an expert or expert system can also be 
uncertain. Some data are clear facts with a yes/no answer, for example: 

The applicant is over the age of 18 
but others may be fuzzy: 

The patient may have suffered from indigestion 
So expertise involves dealing with uncertain data, and uncertain inference rules 
using that data. Much of the skill in judgement lies In weighing up the relative 
merits of data, facts guesses and hypothesis, etc., and using a plausible line of 
reasoning with them. There are essentially two aspects to this uncertainty: belief 
and value. Belief is analogous to probability and measures the level of credibility 
whereas probability is a numerical measure. People generally use words to express 
belief. There are over 50 terms in the English language expressing belief, and the 
number can be increased by qualifiers such as very, extremely etc. However, if a 
subset of these terms could be agreed upon, together with an hierarchy expressing 
the relationships between them, then there is no reason why the expert should not 
be able to express his knowledge in simple English which Is natural to him. For 
example the figure on the next page shows a simple hierarchy showing the 
relationships between terms such as possible, certain and definite. A term low 
down on the hierarchy is stronger than the one higher up. So 'certain' is stronger 
than 'probable', and proved implies 'definite'. The main problem with this is 
ascertaining whether the expert is consistent in his usage of words, and whether 
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the agreed relationships make sense to other people. The other element, that of 
value, is analogous to risk. Terms expressing value are those such as fatal, serious, 
dangerous, undesirable, etc. A possibility which is considered likely and serious 
may warrant immediate Investigation, whereas one which Is highly probable and 
undesirable may not. It will be necessary to draw up similar diagrams representing 


POSSIBLE 



CERTAIN DEFINITE 


PROVED 

Figure (a) Hierarchy chart representing relationships 
between words. 

relationships between words describing risk or value as well, if the uncertainty 
handling is to be written in words. If the expert can do this then it will usually be a 
valuable exercise. The problem, with using words is that there is such an abundance 
to choose from, but the advantage is that the language is easy for the expert to use. 
Risk is extremely important in reasoning processes. A low probability high risk 
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situation might warrant investigation before a high probability low risk one. It Is the 
Importance which matters. Reasoning seems to be multl-dimenslonal and probability 
theory on Its own seldom provides an adequate framework. In other words objective 
probabilities do not embrace all facets of human Judgement. 


3.2 Fuzzy Sets 

Even though numerical models for belief have many disadvantages, it 
cannot be denied that many famous expert systems do use them. Pure probability 
theory has been considered Inadequate and some famous systems use certainty 
factors. Another important theory which Is used In expert systems is the fuzzy set 
theory. Fuzzy set theory and fuzzy logic were formulated by Zadeh, and have since 
been applied to many problems where traditional crisp logic and mathematics are 
inappropriate because of the inherent uncertainty. In traditional logic a proposition 
is true or false; in fuzzy logic it has a degree of truth. For example, let us consider 
the question; 

Is the object black? (or white) 

In crisp logic the answer can be either yes (black) or no (white). In fuzzy logic an 
object would be given a degree of blackness, where 0 Indicates 'definitely not' and 1 
indicates 'definitely'. An off-white object could be measured by 0.2, say, and a grey 
object by 0.6. This would not mean that one was three times as black as the other, 
but would enable the members of a set to be ranked. Let U be the universe of 
discourse or domain; 

U = U i + U2 + + U n 

So U is the set of n objects Ui . U2 U n which we are considering. A fuzzy set F 

is described by its members and their degrees of membership to that set, for 
example: 
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F = M], /Ui + M2/U2 + + M n /U n 

Uj. U2 U n are members with degrees of membership M 1 , M2 M n- a nd + 

denotes union not addition. In other words this equation Is a way of listing the 
various members together with their degrees of membership. Equivalently, F Is 

given by: 

F = IMf (Ui)/Ui 

where Z denotes 'the set of. We also define the fuzzy versions of union (inclusive 

OR). lntersectlon(AND) and complement (NOT). 

The grade of membership of U In the union F t G (F OR G) Is at least 

that of its membership in the Individual sets F, G. We do not know any more than 
this, and so the grade of membership Is given by the maximum of the two. So: 

F U G = Z Mp (U)VMg(U)/U 

where V denotes maximum. The grade of membership of U in FPG (F AND G) can be 
no greater than the membership in each of F and G. So Intersection is defined by: 
FOG = ZMf(U) a Mg(U)/U 

where A denotes minimum. The value 1 denotes full membership and 0 no 
membership. The complement of F, F is given by : 

F = Z(l-Mp(U))/U. 
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XI 



Figure (b) Set of six figures 

Now let us look at an example by considering the objects in figurefb). Suppose L is 
the fuzzy set of large shapes, and R the fuzzy set of round shapes then L and R could 

be defined by: 

L = 0 . 1 /Xi + O.6/X2 + O.6/X3 + O.8/X4 + O.4/X5 + 0 . 2 /X 6 
R = 0 . 1 /Xi + 0 . 7 /X 2 + I.O/X3 +O.5/X4 +O.I/X5 + 1 . 0 /X 6 
L U R is the set of objects which are large or round. Xi is not really large and not 
particularly round, so its membership in LuR is low. X6 is not large but perfectly 

round so its membership in large or round is 1 . 

LU R= 0. 1 /X 1 + 0 . 7 /X 2 + I O/X3 +O.8/X4 +O.4/X5 + 1 . 0 /X 6 

LOR is the set of objects which are large and round 

L = 0. 1 /X 1 +O.6/X2 +O.6/X3 +O.5/X4 +O.I/X5 + 0 . 2 /X 6 
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In this case X5 and X6 have low membership values for large and round (Lr R) 

because membership In at least one of L and R is low. The strongest membership Is 
for X2 and X3 both of which have fairly high membership in both L and in R together. 

L is the set of not large (l.e. small) objects 

L ’= 0 . 9 /Xi + 0.4/X2 + O.4/X3 + O.2/X4 + O.6/X5 + 0 . 8 /X 6 
S0X1 has a high membership in L and X4 has a low membership. The different 
membership values mean that it Is not sensible to count the members in a fuzzy set. 
Instead we can define the power P of a set F by: 

P(F) = I Mf(X) 

So in our flgure(b): 

P(L) = 2.7 

P(R) = 3.4 

P(LUR) = 4.0 

In the next chapter we discuss the concepts of the present work, which is to 
extract fuzzy rules under uncertainty and to measure deflnibility using rough sets. 
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CHAPTER 4 


EXTRACTING FUZZY RULES 
AND MEASURING DEFINIBILITY 

The main purpose of the present work is to study a setting where a 
decision maker (expert) is faced with uncertain (l.e. fuzzy) symptoms and makes a 
fuzzy decision. Let's keep In mind that these decisions may be strongly or weakly 
based on the conditions. From the data we have, we will extract fuzzy rules. In fact 
we will extract two sets of rules l.e. certain and possible rules as well as a measure 
of how much we believe these rules. Finally we will define the decisions in terms of 
the symptoms. Before we go any further we will look at the properties, notations and 
operations of fuzzy sets which is required to understand this work. 


4.1 Functions on pairs of fuzzy sets 

We now look at some functions and properties of fuzzy sets. All the 

concepts explained here can be found in (2). Let’s recall from the previous chapter 

that a fuzzy subset A of U is defined by a characteristic function 

PA : U > (0.11. 

The notation 

Icq/xi (0 <a t 51) 
i 

denotes a fuzzy subset whose characteristic function at xj is ap 

Moreover let us recall that if A and B are fuzzy subsets APB. AuB. -A are defined by 
Min{ pa (x). pb(x) }. Max( pa(x). PB(x) h and 1- PA(x) respectively. The 


implication 


A 


> 


B is defined by -ALB and the characteristic function corresponding to -ALB 


is given by 

Max) 1- A(x). B(x) }. 

Let us now go through an example and see how these work: 

Let A = (.5, .7, .2. .4) and 

Let B = (.4. .8. .9. .6) 

then we have the following : 

Mln{ paW. PbM } = l- 4 - 1 • - 2 - - 4 ) 

Max{ paM. PbM ) = (-5. -8. -9. - 6 ) 

1-PA(x) = ( 5, .3, .8, .6) 

Now we look at two new functions on pairs of fuzzy sets. 

I(ACB) = inf Max{l-A(x), B(x) } 

• x 

J(A#B) = Max Min (A(x), B(x) ). 

X 

where A and B denote fuzzy subsets of the same universe. The function I(ACB) 
measures the degree to which A is included in B and the function J(A#B) measures 
the degree to which A intersects B. If A and B are crisp sets it is evident that 
I(ACB) = 1 if and only if ACB 

otherwise it is O. 

Moreover in the case of crisp sets 

J(A#B) = 1 if and only if APB *<J> 

otherwise it is 0. 

In addition to the above, lets also look at the following relation as shown in (2) 

I (ACB) = 1- J(A#-B). 

The right hand side of the above equation is 
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Inf (1 - Mln{A(x). l-B(x) ) ) 
x 

= Inf Max (l-A(x), 1 -( 1 -B(x)) } 

x 

= inf Max (1 - A(x), B(x) }. 
x 

In the next section we go through an example and show step by step 
how fuzzy certain and possible rules can be extracted from raw data. 

4.2 An Example 

Let us consider the following table which Is the kind of raw data we will 
be dealing with In this work, l.e. we will have a set of conditions and a set of 
decisions whose values are given using the fuzzy set theory. 


Table _1 


PATIENTS 

SIZE 

COLOR 

DECISIONS 

PI 

3/L + .8/S 

,2/R + .9/B 

3/Da + -6Db 

P2 

.4/L + .7/S 

,4/R + .7/B 

,8/Da+ 5/Db 

P3 

7/L+ .4/S 

.6/R+ .7/B 

,5/Da + -9/Db 

P4 

.8/L + .5/S 

,3/R + .8/B 

,7/D A + -3/Db 

P5 

.2/L+ .7/S 

,2/R + .5/R 

.4/Da + 2/Db 

P6 

.9/L+ .2/S 

,8/R + .2/B 

,7/Da+ 8/Db 

P7 

,3/L + .6/S 

.7/R+ .1/B 

.4/Da + 5/Db 


L = Large 

R = Red 

Efc = Disease A 

S = Small 

B = Blue 

Db = Disease B 
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We will Interpret the above table as a case where an expert is trying to determine the 
presence or absence of a disease by looking at the size and color of a tumor. The 

first column represents a number of patients i.e. PI, P 2 P 7 . The symbols L and S 

stand for large and small respectively, and the symbols R and B stand for Red and 
Blue respectively. So we can interpret that patient Pi has a tumor that is Judged to 
be .3 large and .8 small. In this particular case, let us assume that a number of 
physicians are looking at the tumor, and that a certain number of them Judge the 
tumor to be large, and others Judge it to be small. So in our case the numbers .3 and 
.8 denote relative frequencies. However, it d oes not need to be so. i.e. these 
numbers could reflect some judgement and need not be generated as relative 
frequencies. The decision column shows a fuzzy diagnosis. So from our table, one s 
interpretation could be that patient P j is diagnosed to have disease Da and the 
corresponding belief is . 3 . Also patient Pi is diagnosed to have disease Dgand the 

corresponding belief is .6 strong. 

Now what we want to do is to take these cases and unravel them into 
fuzzy rules as to when disease Da or Db Is present. The first step is to take this raw 
data and convert them into fuzzy sets as follows: 

D A =. 3 /Xi + .8/X2 + -5/X3 + .7/X4 + 4/X5 + . 7 /X 6 + .4/X7 
The fuzzy set for Da is obtained by taking the union of the values of Da of all the 
patients. Similarly fuzzy sets are created for large, small, red and blue as follows: 
L=. 3 /Xi + .4/X2 + .7/X3 + 8/X4 + .2/X5 + . 9 /X 6 + 3/X7 

S=.8/Xi + .7/X2 + .4/X3 + .5/X4 + .7/X5 + . 2 /X 6 + .6/X7 

R=. 2 /X 1 + .4/X2 + 6/X3 + .3/X4 + 2/X5 + .8/X6 + .7/X7 

B=. 9 /Xi + . 7 /X 2 + T/X3 + .8/X4 + .5/X5 + . 2 /X 6 + .I/X7 

The next step would be to find the minimum degree to which possible combinations 
of symptoms Imply disease Da i.e. find the certain rules. This is done by computing 
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I(LCDa). I(SCDa). I(RCDa). I(BCDa). I(LPRCDa). HLHBCDa). KSHRCDa). 

Similar computations would be carried out for De- 

Carrying out the computations would yield the following results: 


I(L C De) = .3 
I(R C D A ) = -4 
I(BCDe) = -3 
I(L PBCDa) = .5 
I(S PR CDs) = .5 


I(S C Da) = .3 
1(R c De) = -5 
I(L PR CD a) = -5 
KLPBCDb) = .3 
I(S PB cDa) = .3 


I(L c Da) = .5 
I(S C Db) = .3 
I(B c Da) = -3 
I(L PR CDe) = -6 
I(S PR CDa) = -4 
I(S P B CDe) = -5 

Now all these yield certain rules. But we may not want to keep all the rules in order 
to avoid any partial implications. So we would set a threshold value, say for this 
example let us choose threshold value (a) to be .5. This would throw away any rule 
which evaluates below this threshold. Of course the lower the a is, the more partied 
Implications are taken into account. The choice of a is very much problem 
dependent. So after applying the threshold value the certain rules we eire left with 
are as follows: If the tumor is large then Da is present is 0.5 

If the tumor is large and red then Da is present is 0.5 
If the tumor is large and blue then Da is present is 0.5 
If the tumor is red then De is present is 0.5 
If the tumor is large and red then De is present is 0.6 
If the tumor is small and red then De is present is 0.5 
If the tumor is small and blue then De is present is 0.5 


Next we find the possible rules by using the second function which is J(X#Y). Again 
we choose a threshold value and discard any rules which falls below this threshold 
value. These values measure the degree to which X intersects Y, and the rules 
generated by these are the possible rules. So carrying-out the computations we get : 


32 



J(S # Da) = .7 
J(R# Db) = .8 
J(L HR#Da) = -7 
J(LPB#Db) = .7 
J(S HB#Da) = -7 


J(S # Db) = -6 
J{B # Da) = .7 
J(L P R #Db) = .8 
J(S PR#Da) = .4 
J(S HB#Db) = 7 


J(R# Db) = .7 
J(S# Db) = .7 
J(L PB #Da) = 7 
J(S PR#Db) = 5 


For the possible rules let us set the threshold value (a) to .6. This would yield the 
following possible rules. 

If the tumor is large then Da Is possible 0.7 
If the tumor is small then Da is possible 0.7 
If the tumor is red then Da is possible 0.7 
If the tumor is blue then Da is possible 0.7 
If the tumor is large and red then Da is possible 0.7 
If the tumor is large and blue then Da is possible 0.7 
If the tumor is small and blue then Da Is possible 0.7 
If the tumor is large then Db is possible 0.8 
If the tumor is small then Db is possible 0.6 
If the tumor is red then Db is possible 0.8 
If the tumor is blue. then Db is possible 0.7 
If the tumor is large and red then Db Is possible 0.8 
If the tumor is large and blue then Db is possible 0.7 
If the tumor is small and blue then Db is possible 0.6 
Now we are ready to extract the certain and possible rules. In the next section we 
look at how this Is done. 



« 
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4.3 Extracting Rules 

The method used for extracting rules differ for the certain and possible 
rules. We will look at each case individually. First we look at how to extract certain 

rules. To extract certain rules: 

1) All rules with unique degrees of belief are kept. 

2) In case two or more rules have the same degree of belief then the one 
with the smaller number of attributes are kept. 

Applying these rules to the above stated certain rules we get the following extracted 
certain rules. 

If the tumor is large then Da is present is 0.5 
If the tumor is red then Db Is present is 0.5 
If the tumor is large and red then Db is present is 0.6 
If the tumor is small and blue then Db is present is 0.5 

Now we see how to extract possible rules. The steps are as follows: 

1) All rules with unique degrees of belief are kept. 

2) In case two or more rules have the same degree of belief then the one 
with the larger number of attributes are kept. 

Applying these rules to the possible rules shown above we get the following extracted 

possible rules: 

If the tumor is large and red then Da is possible 0.7 
If the tumor is large and blue then Da is possible 0.7 
If the tumor is small and blue then Da is possible 0.7 
If the tumor is large and red then Db is possible 0.8 
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If the tumor Is large and blue then Db is possible 0.7 
If the tumor Is small and blue then Db Is possible 0.6 


4.4 Measuring Definibility 

Now we turn our attention to defining the fuzzy terms Involved In the 

diagnosis as a function of the terms used in the symptoms. How well we are able to 

do this , is a function of how much the decision follows the conditions. The 

concepts explained here are from (21. Let {BO be a finite family of fuzzy sets which 

does not necessarily form a partition of the universal set. Let A be a fuzzy set. Then 

we can define the lower approximation of A through (Bi) as 

R(A) = UKBiCAJBj. 

1 

In cases where I(BiCA) is less than some threshold a it is advantageous to throw 
away all the sets Bi. In this case we have 
R(A) 0 =UI(BiCA) Bi. 

Similarly we show an upper approximation of A through {Bi} 

H (A) = UJ (Bi # A) Bi 
1 

and 

R (A) a = UJ(Bi # A) Bi 

Returning to our Initial example and applying these concepts: If we choose oto be .5 
and Bi= L; B 2 = LP R: B 3 = LPB; B 4 = STB then we have 
B(Da) .5 = 5 L U .5(SnB) 

Thus we can use a combination of Large and Small and Blue can to describe the set of 
patients that are certainly sick through the symptoms L.S.RB. Similarly, if we pick 
a to be .6 then we get 
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r (Da). 6 = - 7L u - 7S u 7R u 76 
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SUMMARY 

In this work we looked at a method which allows us to acquire 
knowledge from data which contains uncertainty or missing and/or erroneous data. 
The knowledge is acquired by looking at examples. These examples are more or less 
like an information system, that is it contains a set of conditions and a set of 
decisions. These conditions and situations contain attributes whose values are 
subject to judgement, l.e. the attributes are not crisp, but are fuzzy sets. From this 
raw data, which contains uncertainty, we looked at how we could extract rules as 
well as measures of how much we trust these rules. In fact we generated two kinds 
of rules. The two sets of rules we generated were as follows, those generated by 
certainty and those generated by possibility. Finally we looked at how we could 
define the f uzzy terms involved in the decisions as a function of the terms used in 
the conditions. A program which incorporates all this is given at the Appendix 
section. 
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APPENDIX 


A PROGRAM WHICH EXTRACTS FUZZY RULES 


Program Extract_Fuzzy_Rules (Input, Output) ; 


^ ******* 

^ ***** * 

J ***** * 

{ ****** 

^ ***** * 

{ ***** * 

^ ***** * 

{ ***** * 

| ***** * 

^ ****** 

| ****** 

{ ****** 

^ ***** * 

^ ****** 

^ ****** 

^ ***** * 

^ ***** * 
{******* 
{******* 


****************************************************** 


program for partial fulfillment of the requirements 

FOR CS 4395 


Programmers 


Donald Culas 
Jeff Worm 


This program simulate the ideas set forth in 
Dr. Andre de Korvin' s paper, "Extracting Fuzzy Rules 
under uncertainty and Measuring pefinibility using 
Rough Sets" . The program is designed to combine the 
methods of rough sets and fuzzy sets to measure . _ 
uncertainty. Fuzzy rules are extracted to provide 
the user a foundation from which they may formulate 
a decision. 

****************************************************** 

****************************************************** 


****** } 
******} 
****** } 

****** } 
****** j, 

****** } 
****** } 
****** J 
****** } 
****** } 
****** } 
******} 
****** J 
****** j, 
****** J 
****** | 
****** J 
****** J 
****** J 
****** J 


const 

max cases = 100; 


type 

str - string [10]; 

fuzzy array * array [ 1 . ,max_cases] of real; 


struct - record 

attl 

: str; 

att2 

: str; 

value_attl 

: real; 

value_att2 

: real; 

end; 


cond_struct ■ 

record 

consider 

: str; 

firattr 

: str; 

secattr 

: str; 

f irattr_l 

: str; 

f irattr_2 

: str; 

secattr_l 

: str; 

secattr 2 

: str; 


end; 


dec_struct - record 
consider : str; 
firattr : str; 
secattr : str; 
end; 


value_struct 
kind_l 
kind 2 
dec_lcind 
value 
attr 
tag 
end; 


■ record 
: str; 

: str; 

: str; 

: real; 

: integer; 
: integer; 


case 


struct - 
condition 1 

_ Jj Li — """"O 


record 


struct; 

o 4- i /■'f • 


decision 


struct ; 


end; 


info = array [ 1 . .max_cases] of case_struct; 
value array - array [1..9] of value_st ruct ; 


cases : info; 
thresh : real; 

m ch, sit_ch, d_ch, val^ch, see_ch : char; 
no of cases, count : Integer; 
read Hata ; boolean; 

condition : cond struct; 

decision : dec struct; 

condl attl arr, condl att2_arr, cond2_att 1 arr , cond2_att2_arr 
dec attl arr, dec attl arr, inter_array : fuzzy_array; 

decT sub7dec2_suE, decl_inter,dec2_inter : value_array; 


i HI* ******************* PROCEDURE INITIALIZE **********************} 
/************* / 
^ ************* This procedure initializes the strings . **************} 

procedure initialize (var con : cond_struct; 

var dec : dec^struct) ; 


var 

blank : stri 
begin 

blank :■ ' 
con. consider 
con . f irattr 
con . secattr 
con . f irattr_l 
con . f irattr_2 
con.secattr_l 
con . secattr_2 
dec . consider 
dec . f irattr 
dec . secattr 
end; 


string [10]; 


blank; 

blank; 

blank; 

■ blank; 
- blank; 
« blank; 

■ blank; 
> blank; 
blank; 
blank; 


{ INITIALIZE } 


{ INITIALIZE > 


/A*******************************************************************) 

|****************** PROCEDURE READ SITUATION **********************} 
/**** t ****} 
^ * * * * This procedure reads in the conditional and_ decisional ****} 
/**** attributes that the user enters. ****} 

I********************************************************************} 

procedure read situation (var con : cond_struct; 

— var dec : dec struct); 

begin ” { READ SITUATION } 

writeln; 

writeln; 

writeln; - — — . . . . 

writeln ('Please enter the attribute under consideration ); 

write ( ' (eg • tumor , weather , etc . . . ) ; ) > 

readln (con . consider) ; 

write^Please enter the decision attribute (eg. disease, factory, et 

readln (dec. consider) ; 
writeln; 


' we will be 


writeln (' Please enter the two attributes of ', con . consider, ' ', 

oking at'); 

write (' First attribute of ', con . consider, ' : '); 

readln (con . f irattr) ; 

write (' Second attribute of ', con . consider, ' : '); 

readln (con . secattr) ; 

writeln/ 

writeln; 

writeln (' Please enter two attributes for ', con . f irattr) ; 
write ('First attribute for ', con . f irattr, ' : '); 

readln (con . f irattr 1) ; 

write (' Second attribute for ', con . f irattr , ' : '); 

readln (con . firattr_2) ; 

writeln; 

writeln; 

writeln (' Please enter two attributes for ', con . secattr) ; 
write ('First attribute for ', con . secattr, ' : '); 

readln (con . secattr 1 ) ; 

write (' Second attribute for ', con . secattr, ' : '); 

readln (con. secattr_2) ; 

writeln; 

writeln; 

wr it®ln (' Please enter two attributes for ' , dec . consider) ; 
write ('First attribute for ', dec . consider, ' : '); 

readln (dec . f irattr) ; 

write (' Second attribute for ', dec . consider, ' : '); 

readln (dec . secattr) ; 

and . { READ SITUATION } 


{******************★*************** ************************ *******} 

/ **************** PROCEDURE SET FUZZY VALUE ********************} 

J**** ***** 

{**** This procedure reads in real data (i.e. 20, 58, 265) ***** 

{**** a nd converts it into fuzzy values - values between 0 ****} 

/**** and 1 (i.e. 0.7, 0.3, 0.28). ***** 

{■k-k *************************************************************** } 

procedure set fuzzy value (var val, max, min, first val,sec_val : real); 
begin “ ” — ------ { SET FUZZY VALUE } 

if (val > max ) then 
begin 

first_val 1; 
sec_val : ■ 0 ; 

end 


else 

if ( val < min ) then 
begin 

sec_val : ■ 1 ; 
first_val. :■ 0; 

end 

else 

begin 

first_val :« (val - min) / (max-min) ; 
sec_val (max - val) / (max-min) ; 

, nd . end ' { SET FUZZY VALUE } 


**************************************************************** * * * * * } 
************************* READ REAL ******************************* 

• .. . **** i 

* * * * 

f**** This procedure reads in the real (no t fu zzy) va lues„snd ***** 

[**** requires the user to estaSTTaft hi# anrf'ie^ftiues ?or ‘ ’ ***** 

r**** the conditional and decisional attributes. ****} 



{********************************************************************> * 

procedure read real ( con : cond_struct; 

dec : dec_struct; m 

var case arr : info; ^ 

var n : Integer) ; 

Var firattr_l, firattr_ 2 , secattr_l, secattr_2,dec_l,dec_2, value : real; II 

i : integer; m 

ch : char; , 

begin { READ PJ5AL = 

ch : = ' y ' ; M 

i : * 1 ; 

write ('Please enter a number you associate with definitely ' , con . f irattr^- 

: ' ) ; • 

readln (firattr 1); , , ^ , . . .. 

write ('Please enter a number you associate with definitely , con . f irattr^Z 

: '); m 

readln (firattr_2) ; 

write^P lease enter a number you associate with definitely ' , con . secattr^' 

: '); s 

write (Please ¥nter a number you associate with definitely ' , con . secattr_2 

; ' ) ; 5 

readln (secattr_2) ; 

write^Please enter a number you associate with definitely ', dec . firattr^ 
') ; ■ ■ ■ 
write ( ' Plelse enter a number you associate with definitely ' , dec . secattr^_ 


readln (dec 2) ; 

WHILE ( (cK ■ 'y') or (ch ■ ' Y' ) ) do 

begin 


case arr [ i ] . conditional . attl :■ con . f irattr__l ; ^ 

case”arr [ij . conditional . att2 :■ con . f irattr_2 ; 

case arr (i] , condition__2 . attl :■ con.secattr 1; 

case”arr [i] . condition__2 . att2 :■ con. secattr___2; 

case arr [ i ] . decision . att 1 :■ dec . firattr; » 

case” arr[i] . decision . att2 :■ dec.secattr; ^ 

write ('Please enter a value for ', con. firattr, ' ; ); §g 

readln (value) ; _ ... . .. . , m. 

set_fuzzy_value (value, firattr 1 , f irattr_2, case_arr [i] . condition_l 

attl, case arr [i] .condition_l .value_atl2) ; 

~ write ('Please enter a value for ', con.secattr, : ); = 

set fuzzy value (value, secattr_l, secattr_2, case__arr [i] . condition^ .va 
attl, case arr [i] .condition_2 . value_att2) ; , W 

~~ write (' Please enter a value for ', dec . consider, : ), P 

set^fuzzy^value (value, dec_l, dec_2, case__arr [i] . decision . value_attl,^a 
arr [i] . decision . vaTua_ > att2) ; = 

writeln; » 

REPEAT { Makes user enter 'Y f or f S' } ^ 

write^Please enter [y] to input more data or («] to stop : ' ) ; m 

UNTIL ( (ch - 's' ) or (ch - 'S' ) or (ch • 'y ) or (ch - Y ) ), s 

end; ■ 

ch ; - ' ' ; 

n i-l; READ REAL } W 

end; = 



I************************************************************************^' 

I*************** PROCEDURE CREATE CONDITION^ FUZZY SETS * ** ******** ** * * j 

!***! This procedure creates the fuzzy sets for the first condition. ****} 

| ****************************** ************************** } 
procedure create condl fuzzy_sets ( con : info; 

K — n : integer; 

var new_arr_l : fuzzy_array; 
var new arr 2 : fuzzy array ) ; 


var 

i : integer; 
begin 

for i :* 1 to n do 
begin 

new_arr_l [ i ] : “ 

new_arr_2 [ i ] : ■ 

end; 

end; 


{ create condl_fuzzy_sets } 


con [ i ] . condit ion_l . value__att 1 ; 
con [ i ] .condition 1 . value_att2; 

{ create_condl_fuzzy_sets ; 


i ************************************************************************* 

j ****************** CREATE C0NDITI0N_2 FUZZi oBia 

{***1 This procedure creates the fuzzy sets for the *®cond condition. *** 

j *****;****?*********** *************************************************** 

procedure create cond2 fuzzy_sets( con : info; 

^ — n : integer; 

var new_arr_l : fuzzy_array; 
var new arr 2 : fuzzy array) ; 


var 

i : integer; 
begin 

for i :■ 1 to n do 
begin 

new_arr_l[i] : = 
new_arr_2[i] :■ 
end; 

end; 


{ CREATE C0ND_2 FUZZY SETS } 


con [ i] . condit ion_2 . value_att 1 ; 
con [ i ] . condit ion_2 .value_att 2; 

{ CREATE C0ND_2 FUZZY SETS } 


jnn“*!n"**‘*pROCEDUBB*CRElTE DECISION FUZZY SETS »**************** > ^ 

procedure create decision_fuzzy_sets (con : info; 
y — n : integer; 

var new arr 1 : fuzzy_array; 


new arr 2 


fuzzv array) 


var 

i : integer; 
begin 

for i :■ 1 to n do 
begin 

new_arr_l [i] 
new_arr_2 [i j 
end; 

end; 


{ CREATE DECISION FUZZY SETS } 


con[i] . decision. value_attl; 
con[ij . decision. value_att2; 

{ CREATE DECISION FUZZY SETS ) 


{ 


***** . ****. 
j**** This procedure initializee^the^etringe. ^^^^^^— ^^^******* j 


a > 


rocedure init (var arr : value_array) 


i : integer; 

blank : string [10]; 
begin 

blank :• ' 
for i 1 to 9 do 
begin 

arr [i] .kind_l 
arr [i] . kind_2 
arr [i] .tag :» 
end; 

end; 


{ PROCEDURE INIT } 


blank; 

blank; 


{ PROCEDURE INIT } 


J********* 

{ * * * * 

{**** 

procedure 


begin 

arrl [1] 
arrl [ 1 ] 
arrl [2] 
arrl [2] 
arrl [3] 
arrl [3] 
arrl [4] 
arrl [4] 
arrl [5] 
arrl [5] 
arrl [5] 
arrl [6] 
arrl [6] 
arrl [6] 
arrl [7] 
arrl [7] 
arrl [7] 
arrl [8] 
arrl [81 
arrl [8] 
end; 


************************************************************** } 
********* PROCEDURE SET CONDITIONS ****} 

„t_=ond ( eon : array, , 

{ SET CONDITION ) 

. kind_l :- con . f irattr_l ; 

. attr :- 2; 

.kind 1 :■ con . f irattr_2; 

.attr - :- 2; 

t 1 i * con . secattr_l t 

\ . attr : - 2; 

.kind 1 con . secattr_2 ; 

| . attr 2; 

|.kind_l := con . f irattrj. ; 

| .kind_2 :* con . secattr_l ; 

| . attr - : - 3; 

].kind_l con . f irattr 1 ; 

] .kind 2 con . secattr_2 ; 

1 .attr - :- 3; 

1 .kind_l :- con . f irattr_Z; 

1 .kind 2 :— con . secattr_l* 

] .attr - :- 3; 

j .kind_l :- con . f irattr 2; 

] .kind_2 :- con . secattr__2 ; 

] .attr :- 3; ^ SET CONDITION } 


jnnnn“nnnt""**pROCEDURE*SET DECISION^ *.*......*************)_, 

\V*ll This^procedura^asaigns^tha^first^daciaional^attributa^^^****,^ 

procedure s.t_d.cl (doc : ^uUrray) , - - ( 


var 

i ; integer; 
begin 

for i :— 1 to 8 do 

arr [i] . dec_kind : 

end; 


dec . f irattr; 


{ SET DECISI0N_1 } 
{ SET DECISION_l } 


iiii *************** ************************* ********** g 

/ ****%*************** e __ nirrTRTON 2 ********************* *' m i 

J ********************* PROCEDURE SET DECISION^ : 


/***★ This procedure assigns the second decisional attribute **** 

j************************************************************************ 

procedure set_dec2 (dec : dec_struct; 

var arr : value array) ; 


) 

} 

} 


var 

i : integer; 

begin 

for i : * 1 to 8 do 

arr [ i ] .dec kind : * dec 

end; 


{ SET DECISI0N_2 } 


secattr ; 

{ SET DECISI0N_2 } 


/******************************-*** ****** *********************************} 
}*************************** FUNCTION SUB *****************************} 

\**** ***** 
{**** This function evaluates the values of I (Ac B) . This value ***** 

{**** is the degree to which A is included in B and is used to ***** 

/**** generate the certain rules. ***** 

j it***********************************************************************} 

function sub ( j : integer; 

arrl, arr2 : fuzzy_array) : real; 


var 

temp : fuzzy_array; 
min : real; 
i : integer; 

begin 

for i :« 1 to j do 
begin 

temp [i] 1 - arrl [i] ; 

if (arr2 [i] > temp[i] ) then 
temp [i] :* arr2 [i] ; 

end; 

min : * temp [ 1 ] ; 
for i :■ 2 to j do 
begin 

if ( temp [i] < min ) then 
min temp[i]; 

end; 

svib :■ min; 
end; 


{ FUNCTION SUB } 


{ FUNCTION SUB } 


/************************************************ 
{************************** FUNCTION NUM ****** 

{**** 

{**** This function evaluates the values of J(A 
{**** ig the degree to which A intersects B and 
/**** generate the possible rules. 

{ ************************************************ 
function num ( j : integer; 

arrl, arr2 : fuzzy_array) : real; 


*********************} 

**** \ 

# B) . This value ****} 
is used to ****} 

**** } 


var 

temp : fuzzy_array; 
i : integer; 

max : real; 
begin 

for i :« 1 to j do 
begin 

^^Ti] 


o 


arr2 [i] 
arrl li] 


then 


{ FUNCTION NUM } 






else 


temp [ i ] : - arr2 [ i ] 


end; 

max : ” temp[l] ; 
for i :■ 2 to j do 
begin 

if ( temp[i] > max ) then 
max : * temp [i] ; 

end; 

num : * max ; 
end; 


{ FUNCTION NUM } 


/********** *V* ******************************************************* ) 

1 ***************** PROCEDURE INTERMEDIATE a************************} 
\ * * * * 1 
/ * * * * J 

f**** This procedure sets the values in the intermediate array ****} 
/**** for the values of I (A c B) and J (A # B) . ****! 

J ********************************************************** *********** 

procedure inter ( j : integer; 

arrl , arr2 : fuzzy_array; 
var temp array : fuzzy_array) ; 


var 

i : integer; 
begin 

for i :» 1 to j do 
begin 

if ( arrl [ i ] <® arr2[i] ) then 
temp_array [i] arrl[i] 
else 

temp_array [i] :* arr2[i] 

end; 

end; 


{ INTER } 


{ INTER } 





/ *********************************************************************** } 
j********************** PROCEDURE VALUE SUB ************************** }_ 

{**** This procedure assigns the values to the corresponding terms **' ■ 

/**** of T (A c B) It calls on the Function SUB. 

j********************************************************************' 1 

proc«dur« v»lu._»ub( n : ^|";' col , tt2iCo2attl . < UIIy _. rr «y; 1 

co2att2 , decatt ; fuzzy array; 

var new arr : value_array) ; , 


var 

temp_arr : fuzzy__array; 
begin 

new_arr [1] .value :■ sub 
new_arr [2] . value :* sub 
new_arr [3] . value ;■ sub 
new_arr[4] . value :■ sub 
inter (n, colattl, co2attl 
new_arr[5] .value sub 

inter ( n , col att 1 , co2 at 1 2 
new arr [6]. value :■ sub 
inter (n, colatt2 , co2attl 
new arr [7] .value ;™ sub 
inter {n, colatt2, co2att2 
new_arr [ 8 ] . value sub 

end; 


{ VALUE SUB } 
(n, colattl, decatt> ; 

(n, colatt2, decatt) ; 

(n, co2 att 1, decatt) ; 

(n, co2att2, decatt) ; 

, temp_arr) ; 

(n, temp_arr , decatt) ; 

, temp_arr) ; 

(n, temp_arr , decatt) ; 

,temp_arr) ; 

(n, temp_arr, decatt) ; 

, temp_arr) ; 

(n,temp arr, decatt); 

_ { VALUE SUB } 


, ************************************************************** *********’! 

!******************** PROCEDURE INITIALIZE TAG ************************ } 
l * * * * * \ 

/ * * * * * 4 -**! 

{**** This procedure initializes the ******** | 

procedure init_tag ( var arrl : value_array) ; 
var 


i : integer; 
begin 

for i := 1 to 8 do 
arrl [i] . tag := “1; 

end; 


{ INITIALIZE TAG } 
{ INITIALIZE TAG } 


{ VALUE INTER } 


titi , *************************************************************** ******* > 
J******************* PROCEDURE VALUE INTERMEDIATE *********************} 

j**** This procedure assigns the values to the corresponding terms ****| 
)**** of J (A # B) . It calls on the Function NUM. J 

I************************************************************************} 

procedure value inter (n : integer; 

p “ colattl, colatt2, co2attl : fuzzy_array; 

co2att2, decatt : fuzzy_array; 
var new_arr : value_array) ; 

var 

temp_array 

new arr [1] .value : = num (n, colattl, decatt) , 
new - arr [2] . value := num (n, colatt2 , decatt ) ; 
new arr [3] .value ! * num ( n , co2attl, decatt ) , 
new arr [ 4 ] . value i * num (n, co2att2 , decatt) , 
inter (n, colattl , co2attl , temp_array) ; 
new arr[5] .value :* num(n,temp_array,decatt); 
inter (n, colattl, co 2 att 2, temp_array) ; 
new arr[6]. value : = num (n, temp_array, decatt ) ; 
inter (n, colatt 2 , co 2 att 1 , temp_array) ; 
new arr[7]. value num (n, temp_ar ray , decatt) ; 

inter (n, colatt2 , co2att2 , temp_array) ; 

n® w _arr ( 8 ] . value :« num(n,t.mp_array,d.c»tt^ INTER ) 
end; ' 


fuzzy_array; 


^ ***** 

^ * * * * * The following four procedures are 
{***** simply procedures to produce the 
{***** headings for the output. 

{***** 


******* J 
**★**★★ J 
*****} 
***** } 
*****} 
*****} 
***** } 
*******} 
*****★★} 


procedure printall__head; 
begin 

writeln; 

writeln; 

writeln (' These are all the rules )} 

writeln ( ' \ | ' 

writeln ( ' ' ' 

end; 


procedure thresh_head ( tval ; real) ; 
begin 

writeln; 


wr iteln; 

writeln (' These are the rules after applying the threshold value of 
1 : 2 : 1 ) ; 

writeln(' 

' ) ; 

writeln(' ” * 

) ; 

end; 

procedure certain_head; 
begin 

writeln; 

writeln (' The following are the certain rules '); 

writeln ( ' “ ' ) f 

writeln; 

end; 

procedure possible_head; 

begin - 

writeln (' The following are the possible rules '); 

writeln ( ' ' ) f 

writeln; 

end; 


f.V: 


/************************************************************************' 
I * * * * ********** * * * * * * * * PROCEDURE kind rules ************* * * * * * ****** * 

{ * * * * * * * * / 

/**** This procedure asks the user what kind or rules they will use ****} 

{****************************************************************** ******} 
procedure kind rules (var ch : char) ; 

begin “ { KIND RULES } 

writeln; 
writeln; 
ch ; 

REPEAT 

writeln ( 'What kind of rules would you like to see ?' ); 
writeln ( ' ' ) ; - 

writeln (' Please e nte r [a] for all the rules : '); 
writeln ( ' or ' ) ; 

write(' Please enter [e] for the extracted rules: '); 
readln (ch) ; 

UNTIL ( (ch ■ 'a') or (ch - 'A') or (ch - 'e') or (ch - 'E')); 
writeln; 
writeln; 
writeln; 

end; { KIND RULES } 


/************************************************************************} 
}******************** PROCEDURE CHECK THRESHOLD ***********************} 

}**** ****} 
{**** This procedure asks the user if they want to set a threshold ****} 

/**** value for the certain or possible rules. ****} 

{A****************************** a****************************************} 

procedure check__thresh ( var ch : char; 

c_or_p : char) ; 

begin 

ch : - ' ' ; 

writeln; 
writeln; 

write ('Do you want to see only the ); 

if (c_or_p - 'c') then 
write (' certain ') 


( CHECK THRESHOLD } 


HUP 


else 

write (' possible '); 

writ eln ('rules above '); 

writeln(' a threshold value? '); 

writeln; 

REPEAT 

writeln; 

writeln; 

write (' Please enter [y] to see only the '); 

if (c_or_p * ' o') then 
write ( ' certain ' ) 
else 

write (' possible '); 
writeln (' rules which '); 

writeln ('are above a threshold value '); 
writeln ( ' or ' ) ; 

write ('Enter [n] to see all the '); 
if (c_or_p = 'c') then 
write (' certain ' ) 
else 

write (' possible '); 
write (' rules : ' ) ; 

readln (ch) ; 

UNTIL ( ( ch » 'y') or ( ch * 'Y') or (ch » 'n') or (ch ■ 'N')); 
, d . { CHECK THRESHOLD } 


{ ******************************************************** 
{ ****************** PROCEDURE GET THRESHOLD VALUE ***** 

{ * * * * 

/★*** This procedure reads the threshold value if one is 

(******************************************************** 
procedure get_tval ( var num : real; 

var t kind : char) ; 


* * * * 

entered. **** 
**************** 


begin 

write (' Please enter 
if (t kind - 'c' ) 
write ( T certain ' ) 
else 

write (' possible '); 
write (' rules : ' ) ; 

readln (num) ; 
end; 


~ { GET T VAL 

the threshold value for the 7 ’) ; 
then 


{ GET T VAL 


} 


} 

} 

} 

} 

} 


{ 

{ 

{ 

{ 

{ 

{ 

{ 

{ 

{ 


******* 

******* 

****** 

****** 

****** 

****** 

****** 

******* 

******* 


***** 

The following two procedures are ***** 
headings for extracted and/or ***** 

certain rules. ***** 

* * * ** 


* 

* 

* 

★ 

* 

* 

* 

* 

* 


} 

} 

) 

} 

} 

} 

> 

} 

} 


procedure extract_head; 
begin 

writeln; 

writeln; 

writeln (' These are the extracted rules '); 


writeln ( ' ) • 

writeln (' - ') ’> 

writeln; 

end; 


procedure certain extract_head; 

begin 

writeln ( ' ' ) ; 

writeln ( ' ' ) ; , 

These are the extracted certain rules 

writeln 

writeln; 

end; 


) ; 
) ; 


!****************** PROCEDURE PRINT ENGLISH ************************} 

V * ★ * ★ \ 
{ * * * * , 1 
{**** This procedure produces the generated rules A A A ***** j 


procedure print_english 


( 


arrl 
c or_p 
aTpha 
kind 
arr size 


value_array ; 
char; 
real ; 
char; 

: integer) 


var 

i 

print 

blank 

begin 

blank 
for i 


integer; 
boolean; 
string [10] 


{ PRINT ENGLISH ) 


1 to arr size do 


begin 
print 
if 


false; 

'a') 


or ( kind - 'A') ) then 


else 

if 


( ( kind 

begin m 

if (arrl [i] .value >« alpha) then 

print := true sa 

end g 

( (kind - 'e') or (kind - 'E') ) then 

if { (arrl [ i ] .value >* alpha •) and ( arrl [i] .tag » 1) ) then — 

print :■ true; • 

if print then 

be<? write (' If the condition . consider, ' is ' , arrl [i] . kind_l) .Q 


end; 

writeln; 

writeln; 

writeln; 

writeln; 

end; 


if ( 

if 

else 

end; 


arrl [i] . kind 2 <> blank ) then 
write (' and T , arrl [i] .kind_2) ; 
write (' then ' , decision. consider , ' 

( ( c_orp ■ 'c') or ( c_or _p - 'C') 

write ( is present ' ) 

write ( ' is possible ')} 
writeln (arrl [i] .value : 2 : 1) ; 
writeln; 


arrl [i] 
then 


.dec kincl 


{ PRINT ENGLISH } 


,************************************************************************ } 
[***************** PROCEDURE POSSIBLE EXTRACT HEADER ******************* 

j**** This procedure generates the heading for extracted rules. ***** 


A**************************************' 

{ POSSIBLE EXTRACT HEAD } 


,**********************•******** 
procedure po3sible_extract__head; 
begin 

wr iteln ( ' ' ) ; 

writeln (' '); . _ , > 

writeln ( ' These are the extracted possible rules^); 

writeln ( ' ] ; 

writeln ; 
end; 


{ POSSIBLE EXTRACT RULES 


{ ******************** 
{ ******************** 
| * * * * 

{***★ This procedure 
{**** unique I (AcB) 
{**★* than one rule 
j**** of attributes 
{**** kept when deal 

{ ******************** 
procedure extract_rul 


********************************************** 
PROCEDURE EXTRACT RULES ******************* 

extracts the rules. First, all rules with 
and J(A#B) values are kept. Secondly, if more 
has identical I values, the "smaller" in terms 
is kept. Conversely, the "larger" rules are 
ing with identical J values. 
********************************************** 

es (var arrl 
c_o r_p 


******} 

******} 

* * * * j, 

* * * * ^ 

* * # * j, 

* ft ★ * J 

* * ★ * } 

* * ★ * 1 

****** J 


value_array; 
char; 

thresh value : real) ; 


{ EXTRACT RULES } 


var 

n,i,j : integer; 

begin 

n : ■ 9 ; 

for i :* 1 to n-1 do 

begin . , . 

if ( arrl [i] .value >» thresh__value ) then 

begin 

for j : = i + 1 bo n do 
begin 

if ( arrl [ i ] ■ att r <> arrl[j]. att r ) then 
begin 

if ( c or_p - 'c' ) then 
begTn 

if ((( arrl [i] . kind 1 - arrl [ 3 ] . kind_l ) or 

( arrl [ij .kind_l - arrl [ j ] . kind_2 )) and 
( arrl [i] .value - arrl [ j ]. value) ) the- 
begin 

if ( arrl [i]. tag ■ 1) then 
arrl [ j] .tag 0; 

end; 

if ( arrl [i] .tag - -1 ) then 
arrl [i j .tag :■ 1; 

end 

else 

h^ifH ( ( (arrl [i] . kind_l - arrl [ j] .kind_l) or 

(arrl [i] . kind_l * arrl(j] . kind_2)) and 
(arrl [ij .value - arrl [ j ]. value) ) then 
arrlfij.tag :■ 0; 
if ( arrl [ j ] .tag ■ -1 ) then 
arrl [ j ] ■ tag : ■ 1 ; 

end; 

end 

else if (arrl [i] .tag - -1) then 

arrl [ij .tag 1; 

end; 

end; 

, ® nd; { EXTRACT RULES } 

end; 



J*******************************************************+*+***** 

{ ********************** PROCEDURE print rules **************** 
{ * * * * 

{ ** ** This procedure calls on the appropriate modules and print 
{**** the headers and the output --> rules. 

^★★*****************************************************+******* 
procedure print_rules ( dsubl_arr , dsub2_arr : value_array; 

dinter l_arr , dinter2_arr : value__array ) ; 


var 


kind 
c_or p 
t val 


char; 
char; 
real ; 
char; 
integer; 


ch 

size 

begin 

size :» 8; 
kind_rules (kind) ; 
if ( ( kind <> ' q' ) 
begin 

if ( ( kind 


{ PRINT RULES } 


or ( kind <> 'Q') ) then 

■ 'a') or (kind » 'A')) then 


begin 

t_val : * 0 . 0 ; 
c or p : * ' o' ; 
cKeclc* thresh (ch, c_o r_p); 
if ( (ch - 'y') or (ch - 'Y') ) then 

begin 

get_tval (t val,c or __p) ; 
thresh_hea3 (t_vaT) ; 
end; 

printall_head; 

certain_head; 

print_english (decl_sub, c_or_p, t_val, kind, size) ; 
print_english (dec2_sub, c_or__p, t_val, kind, size) ; 
c_or p :=» 'p'; 
t val : * 0.0; 
cHeck thresh (ch, c_or__p) ; 
if ( Tch » 'y') or (ch - ' Y' ) ) then 

begin 

get_tval (t val,c or_p) ; 
thresh_hea3 (t_vaT) ; 
end; - . .= . - : """ 

po s s ib 1 e_he ad ; 

print_english (decl_inter, c_or_p, t_val, kind, size) 
print_english (dec2“inter, c_or_p, t_val, kind, size) 

end 

else 

begin 

ch : - ' ' ; 
t^val :» 0.0; 
c or p : ■ ' c ' ; 
cHeck thresh (ch, c_or_p) ; 
if ( Tch * 'y'^ or (ch - 'Y') ) then 

begin 

get_tval (t val,c or_p) ; 
thresh_hea3 (t_vaT) ; 
end; 

extract_rules (decl__sub, c_or _p, t_val) ; 
extract_head; 

certain__extract_head; . ?- 

print_english (decl__sub, c_or_p, t__val, kind, size) ; 
extract_rules (dec2_sub, c_or _p,t_val); 
print_english (dec2_sub, c_or _p, t_val, kind, size) ; 
t_val 0.0; 
c“or_p :■ ' p' ; 


end; 

end; 

end; 


check thresh (ch, c_or_p) ; 
if ( (ch * ' y' ) or (ch * ' Y' ) 


then 


begin 

get_tval (t val,c_or_p); 
thresh_hea3 it_val) ; 
end; . , 

extract rules (decl_inter, c^or p r t_val) ; 

possible extract head; 

pnnt_english(decl_inter,c_or_p, t_val, kind, size) 

extract rules (dec2 inter, c or_p,t_val) ; 

print_english (dec2_inter , c_or_p, t_val, kind, size) 


{ PRINT RULES ) 


z^********************************************************************^ 

|*********************** PROCEDUF.E ASSIGN VALUES **********************} 

{**** This procedure assigns the values for the ************1 

| *************************************************** *****************} 
Procedure assign_value ( var arrl : info ); { } 

beg a2rl[l] .condition_l.value_attl 0.3; arrl [ 1 ] . condition_l . value_att2 


. 8 ; 

.9; 

.7; 

7; 

.4; 

.7; 

.5; 

. 8 ; 

.7; 

.5; 

. 2 ; 

. 2 ; 

. 6 ; 
. 1 ; 


arrl[l] . condit ion_2 . value_attl :-0.2; arrl [ 1 ] . condition_2 . value_att2 : 
arrl [ 1 ] -decision. value_attl :-0.3; arrl [1] .decision. value_att2 :-0.6; 
arrl [2] . condit ion_l . value.attl :-0.4; arrl [2 ]. condit ion_l . value_att2 : 
arrl [2 ] . condition_2 . value.attl :-0.4; arrl [2 ] . condition_2 . value_att2 : 
arrl [2 ]. decision . value_attl 0.8; arrl [2 ]. decision . value_att2 0.5, 

arrl[ 3 ]. conditional. value.att! 0.7; arrl [3] . condition_l . v.lue_att2 
arrl [3] . condit ion_2 .value_attl :« 0.6; arrl [3] . condition^ .value_att2 
arrl [ 3 ] .decision. value_attl 0.5; arrl [3] . decision . value_att2 0.9 

arrl [4] .conditional. value.attl 0.8; arrl [4] . conditional . value.att 
arrl [4] .condit ion_2.value.attl 0.3; arrl [4] . condition^ . value_att2 
arrl [ 4 ] .decision. value_attl 0.7; arrl [4] . decision . value_att2 0.3 

arrl [ 5 ] .conditional. value.attl 0.2; arrl [ 5 ] . conditional . value_att2 
arrl[5] .con 4 ition_ 2 .value_attl 0.2; arrl [5] . condition_2 . value_att2 

arrl [ 5 ] .decision. value_attl 0.4; arrl [5] . decision. value_att2 :-0.2 

arrl [6] .condit ion_l.value_attl 0.9; arrl [6] .condition.l . value_att2 

arrl [6] . condit ion_2 . value___attl 0.8; arrl [ 6] . condition^ . value_att2 

arrl [6] .decision. value_attl 0.7; arrl [ 6] . decision . value_att2 0.8 

arrl [7] . condit ion_l . value_attl 0.3; arrl [7] . condition,! . value.*tt2 

arrl ( 7 ] .condition_2.value.attl:- 0.7; arrl [ 7 ] . condit ion_2 . value_.tt 2 
arrim. decision, value.attl 0.4; arrl [7] .decision. value_att2 


0.5 



end; 


{ ASSIGN VALUES } 


* 

1 

* * i 

* * ' 


,**************************************************************'*********’ 
|************************* PROCEDURE EXAMPLE *************************** 

jlltt This procedure assigns the conditional and decisional attributes 

{ * * * I * * 52 * * 5“* i * * *.*.* i************ ? ^***** ; ***************** ************ 

procedure example (var con : cond_struct; 

var dec : dec_struct; 
var case_arr : info) ; 

var 


integer; 


{ EXAMPLE } 


initialize (con 

/ 

dec) ; 

con. consider : 

* 

' tumor' ; 

dec. consider : 

3K 

' disease' 

con . f irattr : 


'size'; 

con.secattr : 


' color' ; 

con . f irattr_l 

* 

■ ' large' ; 

con . f irattr_2 


: * ' small 

con . secattr^l 


: - ' red' ; 

con . secatt r_2 

: 

- 'blue' ; 

dec.firattr : 

■ 

'Da' ; 

dec.secattr : 


'Db' ; 

for i :w 1 to 

8 

do 


end; 


begin 

case_arr [ i ] . condition_l . att 1 
case_arr [ i ] . condition_l . att2 
case_arr(ij . condit ion_2 . att 1 
case~arr (ij . condit ion_2 . att2 
case_arr[i] . decision . att 1 
case_arr(i] . decision . att2 
end; 

assign_value ( case_arr ) ; 


■ con . f irattr_l ; 

■ con . f irattr — 2 ; 
» con . secattr_l ; 
» con . secattr_2 ; 

■ dec.firattr; 

- dec.secattr; 


{ EXAMPLE } 


( **** 
j **** 

{*************** 
procedure menu ( 
begin 

sel '4' 
REPEAT 


*********** procedure menu ************************* } 

This procedure creates the main menu^ ^ ******** | 

char ) ; , 


writeln (' 

*★ 

writeln ( ' 

* * 

writeln ( ' 

* * 

writeln < ' 

★ ★ 

writeln ( ' 

* * 

writeln ( ' 

* * 

writeln ( ' 
writeln; 
writeln; 
writeln; 
writeln ( ' 
writeln ( ' 

★ ★ 

writeln (' 
writeln {' 
writeln (' 



WELCOME TO THE CULAS-WORM DECISION MAKER 


* * ' 
** 9 
* * f 


Here are the choices ' ) ; 

********************** '); 

1) Show a sample run of this program '); 

2) Run the program using your data ) ; 



writeln (' 3) Quit 

writeln ( ' ' ) : 

writeln ( ' ' ) ; . 

write {' Please enter your choice 1, 2, or 3 : ); 

readln ( sel ) ; 

UNTIL ( ( sel - '1') or (sel - '2') or (sel - '3') ); 

d . { MAIN } 


{ 

{ 

( 

{ 

{ 

( 


********* 

********* 


************************************************* 
************* p PROCEDURE ASK SIT *************** 


******* 

******* 


* * * * 

**** This procedure asks the user if they would 
**** data for a different run. 
************************************************* 


like to use the 
**************** 


procedure ask_sit (var choice : char; 

var cont : integer) ; 

begin 

choice : = ' ' ; 

REPEAT 

writeln ( ' Do you want to use the same 
write ( 'Please enter [y] or [n] '); 

readln (choice) ; 

UNTIL ( (choice 35 ' y' ) or (choice * 'Y') 
(choice * ' N' ) ) ; 

end; 


{ ASK SIT } 

attributes as previously 

or ( choice * ' n' ) or 
{ . ASK SIT } 


★ *** + *★* j 

*★**★★★♦ j 

★ * * * J, 

★ * ★ * } 

* ★ ★ ★ \ 

********\ 


used ' ) ; 


im,****** ****************************************** ************ 

{********************* PROCEDURE ASK DATA KIND ************** 

{**** This procedure asks the user what type of data they will 
{**** using - real or fuzzy. 

{a************************************************************* 

procedure ask data kind ( var ch : char) ; 

begin “ { ASK DATA KIND } 

ch : - ' ' ; 

REPEAT 

writeln; 

writeln; 

writeln ('What kind of data do you want to use ? ); 
writeln; 

writeln ('Real kind : eg. ( 20 30 92 ) '); 

writeln (' or '); 

writeln ('Fuzzy kind : (values between 0 and 1 

writeln; _ 

write ('Please enter [r] for real or [f] for fuzzy : '); 

readln (ch) ; 

UNTIL ( (ch m 'r') or (ch» f R' ) or (ch*' £' ) or (ch-' F' ) ); 

end; { ASK DATA KIND } 


j 


**★★**★* \ 

**** } 
be ****} 

* * ★ ★ j 


eg . ( . 1 ♦ 4 . 7 ) ' ) ; 


,***********************************************************************) 
/*★★*********★*★★★★★*★★ procedure READ FUZZY *************************) 

\ ★ ★ ★ ★ X 

/ * * * * J 

/**★* This procedure reads in the fuzzy values. ***** 

| **************************************************** ******************** 
procedure read_fuzzy (con : cond_struct; 

dec : dec — struct; 
var case^arr : info; 
var n : Integer) ; 


var 

i 


: integer 


w r 1 1 e I n ; 


writeln <' Would you like to see the data being used ■ M 
write (' Please enter [y] or [nl : ') ■ 9 a • ); 

readln(ch); 

end Untl1 ( ( Ch " ' y,) or (ch * '*'> or (eh - 'n') or (ch 


{ ASK SEE 


'N') ) ; 


{ ******** 

(*********************** PRnrFnTTnB- DBTMT **************1 

(**** DURE PRINT DATA ***********************j 

[**** This is the procedure to print *-he data Hill 

procedure print_dat (arrl : info; ******************** } 

con : cond^struct ; 

dec : deconstruct; 

n : integer ) ; 

var 

i : integer; 

begin , 

writeln (' Data being used '); RINT DATA } 

writeln; 

writeln; 

“ rit * ln< ' ^nf^c^id.'r ” nSid * r “ i0n * r * 

writeln; 

writeln; 

for i ;» 1 to n do 
begin 

writeln (arrl [i] .conditional. attl: 10,' - ' :2, arrl [i] .condition 1. value 


ttl ; 2 : 1 
t2 : 2 : 1) 
ttl : 2 : 1 
t2 : 2 : 1) 
1, 

) ; 


10 , arrl [i J .conditional -att 2 : 10 , ' - ' : 2 , arrl [i] . condition,! . v,l u ._, t 

writ.ln(arrl[i].conditi O n_2.attl:10,' - ' : 2, am [i ] . condition,! . 

10, arrl [i] . condition 2 .att 2 : 10 ,' ■ '2 irririi 

_ arrl [1] . condition_ 2 . value at 

writ.ln(arrl(i].daci,ion.attl:10,' - ' : 2, arrl [i] . d.oi.ion . v.L._, t t U2 : 
' ; 10 ,.rrl[i] . daciaion . att 2 : 10 , ' - ' , 2 , arrl [i J . daci.ian . r.lu. att 2 :2 ,l 


writeln; 

writeln; 

end; 

end; 


{ PRINT DATA } 


BEGIN 

initialize (condition, decision) ; 
count :» 0; 
m_ch : - ' 4 ' ; 

repeat 

read_data :■ false; 

menujnt ch) ; 


{ MAIN } 


char ; 


:a 

begin 

ch : » ' y ' ; 
l : - 1 ; 

while ( (ch 
begin 

case_arr [ i ] 
case_arr ( i j 
case_arr [ i ] 
case_arr [ i j 
case_arr [ i j 
case arr [i] 


READ FUZZY 


' y' ) or (ch 


Y') ) do 


. conditional . attl 
. condition_l . att2 
. condition_2 . attl 
.condition 2.att2 


. decision . attl :« 

_ . . . decision . att2 :■ 

write (' Please enter a value for 
readln (case_arr [ i ]. condition 1 

write ('Please enter a value Tor 


con . f irattr_l ; 
con . f iratt r_2 ; 
con . secattr_l ; 
con . secatt r 2 ; 


dec . f iratt r; 
dec . secatt r ; 

' f con. f iratt r_l , 
value_attl) ; 

, con.firattr 2, 


r_l, 


end; 

n 

ch 

end; 


readln (case_arr [ i ]. condition 1. value att2) 
wr ite (' Please enter a value Tor ' , con . secattr 
readln (case_arr [ i ]. condition 2 . value attl)' 
wrrte ('Piease enter a value Tor coH. secattr 2, 
readln (case_arr[i] .condition 2 . value att2) ; ~ 

write ('Please enter a value Tor ' , dec . f irattr ' 
readln (case_arr [ i ]. decision . value attl); 
write ('Please enter a value for ' 7dec . secattr, ' 

readln (case_arr [ i] . decision . value att 2 ) * 
i : ■ i + 1 ; — 

REPEAT 

writeln; 

write ('Please enter [y] to input more data or [s] to 
readln (ch); 1 J 

UNTIL ( (ch 


Stop 


i-1; 

r f . 


s ) or (ch ■ 'S') or (ch m ' y' ) or (ch <■ 


{ READ FUZZY } 


Y') ) 


I*”** 7„ th,y “ ,nt t0 — th * — *•**• 

{ ******************* *************************************************„,/ 
procedure ask_value ( var ask_val : char) ; 


begin 
repeat 

writeln; 
writeln ( ' Do 


{ ASK VALUE } 


you 


end; 


write ('Please enter [y] 
readln ( ask val); 
until ( (sale „val - 'y') 
(ask_vaT - 'N') ); 


want to use the same values as previously used 
ter [y] for yes; or fnl for no ; m .• 


for yes; 
or (ask val 


[n] for no 

, '*') 

{ ASK VALUE 


') ; 

or (ask val ■ 


') ; 


'n') or 


j**il********************** PROCEDURE ASK SEE **************!*****^*H j 

/*★** Procedure asks the user if they want to see the data **★*! 

{******* at 13 b ® in 9 ua «d. ****| 

procedure ask see ( var ch : char); * *******} 


( . — 

procedure ask_see ( var ch : char) ; 
begin 

repeat 
writeln; 


{ ASK SEE } 



, c 


' : ' ) 


Z ' ) ) then 


. ( ( m 

begin 
if 


:n 


:a 


) then 


else if 

begin 

if 


( m ch = 
begin 

no_of_cases ; = 7; 

example (condition, decision, cases) / 
ask^see (see_ch) ; 

if ( ( see_ch * 'y') or (set^ch » ' Y ' ) ) then 

print — dat (cases, condition, decision, no_of_cases) 

end 

m_ch » '2') then 

( count = 0) then 
begin 

read^data :* true; 
count :* count + 1; 
initialize (condition, decision) ; 
read situation (condition, decision) ; 


end 

else 

begin 

ask_sit (sit ch, count) ; 

if ( (sit_cK - 'n') or (sit_ch ■ 'N') ) then 
begin 

read data :* true; 

initialize (condition, decision) ; 

read_situat ion (condition, decision) 


end 

else 

begin 

ask_value (val_ch) ; 

if ( (val__ch - 'n') or (val_ch ■ 'N') ) then 
read_data :* true; 
end; 


end; 

if read_data then 
begin 

ask data_kind(d ch) ; 

if T (d_ch - ' r 7 ") or (d^ch - 'R') ) then 
read_real (condition, decision, cases, no_of_cases) 
els® 

read_fuzzy (condition, decision, cases, no_o£_cases) ; 
ask_see (see_ch) ; 

if ( ( see_ch - ' y') or (search ■ ' Y' ) ) then 

print_dat (cases , condition, decision, no_of_cases) ; 
end; 


end; 


create_condl_fuzzy_sets (cases, no_of_cases, condl_attl_arr, condl_att2 arr) 

create_cond2 fuzzy_sets (cases, no_of_cases, eond2”attl”’arr, eond2 att2 arr) 

create~decisTon_fuzzy_sets (cases, no_of_cases, dec_attT_arr,dec_att2_arr) ; 

init (decl__sub) ; 

init (dec2_sub) ; 

init (decl__inter) ; 

init (dec2_inter) ; 

set_cond (condition, dec l_sub) ; 

set_cond (condition, dec2_sub) ; 

set_cond (condition, decl_inter) ; 

set_cond (condition, dec2_inter) ; 

set_decl (decision, decl_sub) ; 

set_decl (decision, decl_inter) ; 

set_dec2 (decision, dec2_sub) ; 

set_dec2 (decision, dec2_inter) ; 

value_sub (no_of_cases, condl_attl_arr , condl att2_arr, cond2_attl_arr, 
cond2_att2_arr, dec_attl_arr,3eel sub) ; 
value_sub (no_of_cases, condl_att l_arr , condl__att7_arr, cond2_att l_arr, 



cond2_att2_arr , dec_att 2_arr, dec2_sub) ; 
value inter (no_of_cases, condl_attl_arr , condl_att2_arr, cond2_attl 
“ cond 2 _att 2 _arr , dec_attl_arr, decl_inter) ; 

value inter (no of_cases , condl attl_arr, condl_att2_arr, cond2 attl 
“ cond2_att2 arr , 3ec_att2_arr, dec2^_inter) ; 

print rules (decl sub, dec? sub,decl inter, dec2_xnter) ; 


end; 

until (m_ch * ' 3' ) ; 
end . 


( MAIN } 


? 


arr 

arr 





